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ABSTRACT 


A group  theoretic  algorithm  for  the  Integer  program  has  been  computer 
programmed  and  tested.  It  basically  consists  of  a linear  programming  algo- 
rithm, a routine  which  converts  the  (relaxed)  integer  program  to  a group  mini- 
mization problem  (over  the  fractional  column  group  or  the  isomorphic  factor 
group  attained  via  Smith’s  Normal  Form),  solving  the  group  problem  by  dynamic 
programming  or  by  a shortest  path  algorithm,  and  when  necessary,  uses  a branch 
and  bound  procedure.  Details  and  computational  results  are  given.  Future 
work  regarding  other  computational  strategies  available  to  group  theoretic 
algorithms  is  also  included. 


ii 
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II 


1.  INTRODUCTION 

In  1960  Ralph  Gomory  [Gl]  indicated  that  the  coefficient  vectors  of  the 
in'.-';ualities  derived  in  his  dual  fractional  algorithm  form  an  abelian  group, 
which  can  have  at  most  D elements,  where  D is  the  absolute  value  of  the  deter- 
minant of  the  current  linear  programming  basis.  Based  on  these  results  Gomory 
[G2]  in  1965  showed  that  by  relaxing  nonnegativity,  but  not  integrality  constraints 
on  certain  variables,  an  integer  program  may  be  transformed  to  one  whose  columns 
of  constraint  coefficients,  and  the  right  hand  side  are  elements  of  an  abelian 
group.  If  this  group  problem  is  solved  and  its  solution  yields  nonnegative 
values  for  the  variables  of  the  original  problem,  then  the  integer  program  has 
been  solved.  The  group  problem  can  be  treated  as  an  integer  program  with  one 
constraint  (i.e.,  a knapsack  problem)  or  as  a network  problem,  where  a shortest 
route  is  desired.  In  this  paper,  we  will  discuss  solution  strategies  for  the 
group  minimization  problem  . Some  computational  experience  will  be  presented. 
Future  work,  now  being  developed,  will  also  be  mentioned. 

Consider  the  integer  program 
PI  maximize  cx 

subject  to  Ax  » b 

x >_  0 and  integer, 

where  A = (AJI)  (i.e.,  original  problem  is  of  the  form  A'x^<  b)  is  an  m by 
m + n matrix  whose  rank  is  m,  I is  an  m identity  matrix,  c ■ (c'»  0),  and 
x = (x',  s') , where  s are  slack  variables.  Now  suppose  B is  a basis  whose 
columns  are  from  A,  and  that  we  rearrange  the  terms  in  the  previous  problem 
so  that  it  is  the  same  as 
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1 

1 P2 

maximize 

CBXB  + CNXN 

! 

j 

subject  to  B Xg  + N * b 

xR  > 0,  Xjj  >.  0 and  integer, 

where  x^  (x^)  are  the  basic  (nonbasic)  variables  associated  with  B (N) , and  the 
costs  corresponding  to  the  basic  (nonbasic)  variables  are  cR  (CN) . Uping  the 
integrality  of  Xg  we  get  the  equivalent  problem  P3. 


P3  maximize  c^B  ^b  - (c^B  - c^)  x^ 


subject  to  B N ^ 


“•4  x.,  = B_1b 


(mod  1) 


>_  0,  integer 


B_1b  - b-1N  Xjj  1 0. 


Suppose  that  we  choose  a basis  B which  yields  a dual  feasible  solution,  that  is 


c - cbB  « - °n  > 


>_  0;  for  example,  the  optimal  linear  programming  basis  may  be 

. . . . _ n“lt  *-1 1 ~ 


selected.  Dropping  the  constant  term  CgB  b,  converting  the  problem  into 
minimization  format,  and  omitting  the  nonnegativity  requirements  xB>  yields 

F4  minimize  c 


subject  to  B Xjj  = B ^b 


and  Xjj  >_  0,  integer. 

This  probj.em  is  equivalent  to 


(mod  1) 


P5(GhP)  minimize 


^ °j  XJ(j) 


subject  to  l Xj^  = aQ 

j— 


(mod  1) 


xj(j)  — ® and  integer 


( j = 1,  . • • > n). 


where  c = (c^)  >_  0,  column  a,  (j  = 0,  . . . , n)  is  the  fractional  parts  of  the 
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j**1  column  of  b"*^N  and  satisfies  0 <_  ct^  < e (a  column  of  ones),  and  - (Xj^) 
is  the  jth  (1  v j <n)  nonbasic  variable.  Problem  P5  is  referred  to  as  the  group 
minimization  problem  (GMP)  over  the  fractional  column  group. 

Denote  the  set  of  vectors  generated  by  repeated  additions  (modulo  1) 
of  the  n a^'s  in  P5  as  G(a).  Then  it  can  be  shown  [SI],  either  G(a)  is  a 
cyclic  group  or  it  can  be  expressed  as  a direct  sum  of  cyclic  subgroups.  More- 
over, the  order  of  G(a)  equals  D or  it  divides  D.  Also,  it  equals  D whenever 
A contains  an  identity  matrix. 

To  solve  GMP,  we  can  think  of  the  equalities  (1)  as  one  constraint  and 
apply  a dynamic  programming  procedure.  In  particular,  for  k ■ 1,  ...,  n let 

k 

f(k,g)  ^ minimize  ^ Cj  Xj^ 

k 

subject  to  l 5^  = g (mod  1) 

Xjq^  >.0  and  integer  (j=l,  ...»  k). 

That  is,  f(k,g)  is  the  minimal  value  of  the  objective  function  to  the  GMP  using 
the  first  k variables  and  with  right  hand  side  aQ  replaced  by  g,  and  f(n,aQ) 


is  the  value  of  the  minimal  solution  to  the  GMP.  The  recursive  relationship  (2) 
allows  us  to  compute  f(k,g)  for  all  k = 1,  ...,  n and  g in  G(a)  provided  that 
every  generates  the  group  G(a) . 

f(k,g)  = minimum  {f(k-l,g),  c^  + f(k,g-ak>}  (2) 


To  retrieve  the  solution,  we  define  j(k,g)  to  be  the  index  of  the  last  variable 
used  in  making  up  f(k,g).  Thus,  j(l,g)  = 1 for  all  g and  for  k >_  2 define 


and 


j (k,g)  = j (k-l,g)  if  Xj^  = 0 or  f(k,g)  = f(k-l,g) 
j(k,g)  = k 


if  Xj^  >_  1 or  f (k,g)  = Cy  + f(k,g-ak) 

If  each  dj  does  not  generate  the  group  G(a),we  may  use  a modified  pro- 
cedure suggested  by  T.C.  Hu  [HI].  In  particular,  suppose  (k  >_  2)  generates  a 
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subgroup  G(ak)  of  order  d < D.  Expression  (2)  will  give  f(k,  Bot^)  for 
£ ■ l,...,d,  but  suppose  we  need  f(k,g)  for  an  element  g which  is  not  in 
G(ak).  We  have  the  value  of  f(k-l,g),  and  need  the  value  of  f(k,g-ok>  to 
calculate  f(k,g).  So,  we  temporarily  assume  that  f(k,g-ak>  - f(k-l,g-ak>, 
which  is,  at  worst,  an  overestimate.  Note  that  f(k-l,g-uk)  is  known.  We  use 
the  following  modified  recursive  relationship. 

f(k,g  + 001^)  * minimum  {f(k-l,g  + 3*^)*  + f(k,g  +“  } (3) 

V y / V y mS 

known  tentatively  estimated 

Starting  with  3 * 1,  we  obtain  a new  estimate  for  f(k,g)  when  3 ■ d,  and  if 
this  value  agrees  with  the  original  one  it  can  be  shown  to  be  the  correct 
value  ([SI]).  If  it  differs,  the  process  continues.  This  process  converges 

to  the  correct  value  sometime  between  step  d and  step  2d  inclusively. 

If  the  optimal  solution,  x^,  for  the  group  minimization  problem  yields 
nonnegative  basic  variables,  Xg,  then  (x-^)  is  an  optimal  solution  to  the 
original  IP  problem.  Specifically,  given  the  solution  for  GMP,  Xj^,  if 
^ = B-1b  - B_1N  Xjj  >_  0 

then  we  have  solved  the  IP  problem.  If,  on  the  o • sr  hand,  one  or  more  of  the 

basic  variables  turns  out  to  be  negative,  we  have  to  seek  the  smallest  value 

of  cx?]  for  which  Xg  >_  0 and  x^j  satisfies  the  constraints  of  the  GMP. 

til 

White  [Wl]  developed  an  algorithm  to  find  the  k best  solution  to  the 
group  problem  using  a set  of  recursive  relationships.  This  is  rather  compli- 
cated and  difficult  to  implement.  Instead  of  White's  approach,  we  use 
a branch  and  bound  enumeration  which  is  similar  to  the  Dakin  [Dl]  variation. 

The  scheme  presented  here  inspects  the  integer  solutions  to  the  group  problem 

by  successively  adding  constraints  of  the  form  L K (j*l n) , where 

K starts  at  0 and  is  increased  by  1.  In  terms  of  tree,  a node  corresponds  to 
a vector  with  a greater  than  or  equal  to  inequality  acting  on  each  variable, 
a branch  to  introducing  the  inequality  in  such  a way  that  two  nodes  are  joined 
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by  a branch  whenever  the  inequality  acting  on  one  particular  variable  has  been 
incremented  by  1 and  the  others  are  the  same.  A detailed  explanation  of  the 
procedure  is  in  [SI] . 

Using  Smith’s  Normal  Form  (SNF)  [HI],  [Ml]  v.v  can  construct  a different 
group  minimization  problem.  In  particular,  SNF  diagonalizes  a given  m by  m 
nonsingular  integral  (basis)  matrix  B,  such  that  'B'  - RBC,  where  S'  1.8  a diagonal 
matrix  of  the  form 


o 


the  are  positive  integers  (ial,...,m),  divides  e^_1  (i*l, . . . ,m-l) , and 
|det.  R|  * |det.  c|  ■ 1.  This  can  be  used  to  construct  the  group  minimization 
problem  (see[Sl]) 

n 

P6  (FGMP)  minimize  £ Cj  Xj(j) 


n 1 

subject  to  l A xT/i\  = A mod  [ 


^ XJ(J)  - o 


xJ(j)  and  inte8er  (j=1 n), 

where  A^  is  the  j ^ column  of  RN  with  each  component  i reduced  modulo  Aq 
is  the  vector  Rb  with  each  element  reduced  modulo  e_^,  and  B = RBC.  The  set  G(A) 
generated  by  the  A^’s  (j=l,  ...,  n)  is  an  abelian  group  which  can  be  shown  to 
be  isomorphic  to  G(a) . The  details  are  in  [SI]. 


Note  that  if  e 


"i*1,  .1,  Xij  XJ(j)  E Xio  (mod  e^)  is  satisfied  for  any 

j=l 


integer  solution.  Here  A^  is  the  i^  element  of  the  col  ^n  of  RN.  This  is 
because  all  elements  of  the  constraint  matrix  are  integer,  ns  well  as  the  right 


^pwiWiwnr.nfcH  ■■»»,  e. » ^ ^ ., ... 


- 6 - 


th 

hand  side.  In  this  case,  the  i.  congruence  equation  contains  only  zeros  and 
thus  can  be  omitted.  This  means  that  all  rows  which  have  e^«l  can  be  omitted 
from  the  constraints.  We  will  denote  the  number  of  effective  rows  in  FGMP  as 
mp,  which  is  m minus  the  number  of  rows  with  e^*l.  Gorry,  Northrup,  and 
Shapiro  [G3]  claim  that  nip  is  usually  1 to  5 regardless  of  the  value  of  m. 

2.  THE  GROUP  MINIMIZATION  ALGORITHM 

The  intension  of  this  paper  is  to  expose  the  efficacy  of  various  existing 
options.  Specifically,  we  have  the  three  major  options  in  this  algorithm  listed  in 
Table  1.  Moreover,  there  are  many  strategies  for  each  option.  The  natural 


A.  Form  of  the  group 
minimization 
problem 

(1)  Regular  group  mini- 
mization problem 
(using  fractional 
columns 

(2)  Factor  group  mini- 
mization problem 
(using  SNF) 

B.  How  to  solve  the 
group  minimization 
problem 

(1)  Dynamic  programming 
algorithm  (DP) 

(2)  Shortest  path 
algorithm  (SP) 

C.  How  to  solve  the 
integer  program  if 
the  group  problem 
does  not  solve  it. 

(1)  Branch 

and  bound 

(2)  Dynamic 
program- 
ming 

(3)  kth  shortest 
path  algorithm 

TABLE  1 

question  is  which  of  the  various  possibilities  appears  to  be  most  efficient. 

Some  computational  work  in  this  direction  has  already  appeared  in  the  literature 
([Cl,  S3,  Wl,  G3,  G4,  G5,  H4]).  An  exposition  of  that  work  can  be  found  in  [SI], 
Table  2 summarizes  the  strategies  used  and  numerical  results,  Even  though  some 
studies  attempt  to  compare  possible  strategies  they  are,  at  best,  quite  incom- 
plete. The  work  by  Gorry,  Northrup  and  Shapiro  [G3]  is  somewhat  more  extensive, 
but  the  comparisons  of  various  strategies  is  not  included. 
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A computer  system  with  several  subroutine  options,  for  solving  an  integer 
program  using  group  minimization  techniques  has  been  developed.  The  general 
procedures  of  our  code  appears  in  Figure  1 and  the  detailed  flow  charts  or  iaajor 
subprograms  are  in  later  pages.  We  now  discuss  the  composition  of  the  computer 
system.  The  paranthesized  letter  adjacent  to  each  heading  agrees  with  Figure  1. 
(a)  The  IT  Code 

The  linear  programming  algorithm  used  in  this  code  is  a variation  of 
the  revised  simplex  method  applied  to  the  dual.  The  basis  inverse  is  kept  in 
produce  form  and  a basis  reinversion  procedure  is  used  to  reduce  roundoff  errors. 
The  original  program  was  written  by  Salkin  and  Spielberg  [S2]  and  was  later 
modified  for  and  incorporated  in  the  set  covering  code  SCA  1 [S2] . 

Because  it  uses  the  dual  method,  the  algorithm  requires  dual  feasibility. 
If  the  primal  is  feasible,  the  solution  is  optimal.  It  turns  out  that  a basic 
dual  feasible  solution  can  always  be  obtained  by  using  the  complementing  variables 


Xj,  for  those  variables  with  negative  costs.  Here  u^  is  an  integral 


upper  bound  for  Xj . Using  this  technique  we  can  avoid  a phase  I procedure. 

j 


(b)  Construction  of  the  Group  Problem 

This  part  of  the  program  converts  the  relaxed  integer  program  to  a group 
minimization  problem.  The  resulting  problem  may  be  either  the  one  over  the 
fractional  column  group  (GMP)(bl),  or  the  one  over  the  isomorphic  factor  group 
(FGMP) (b3)  attained  via  Smith's  normal  form  (SNF) (b2) . More  specifically,  given 
the  LP  optimal  solution  GMP  converts  problem  PI  into  P5,  whereas  FGMP  converts 
PI  into  F6  with  the  diagonalized  LP  optimal  basis  matrix  produced  by  SNF. 

Clearly  it  is  more  time  consuming  to  diagonalize  the  b tFxs  matrix,  but 


the  number  of  rows  of  FGMP  usually  is  much  less  than  that  of  GMP.  This  allows 
a simpler  bookkeeping  scheme  to  keep  track  of  the  problem  and  less  computer 
storage  requirements.  A trade-off  exists  between  SNF  conversion  time  and  the 
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(a)  LP  (linear  programming) 
LP  solution,  LP  optimal  basis 


(b3)  FGMP  (factor  group  minimization  problem) 


(cl)  DP  (dynamic  programming) 


(c2)  SOL 

Backtracking  of  DP  solutions, 
including  alternative  optimum 


(c3)  SP  (shortest  path)  < j 

solving  and  backtracking  the  Group 
problem  by  shortest  path  algorithm 


.basic  variables  > 0 


(d2)  BANDB  (branch  and  bound) 
branch  and  bound  enumeration  to  find 
a solution  with  nonnegative  values 
for  the  basic  variables 


(d2)  KSr'  (k  shortest  oath) 
ttl 

finding  the  k shortest  path  such 
that  the  basic  variables  are 
nonnegative 


Solution  of  original  problem 


S 


easier  handling  allowed  in  the  other  procedure.  The  selection  of  the  group  is 
made  by  an  input  parameter. 

A flow  chart  representing  the  construction  of  a group  problem  appears 
in  Figure  2 and  that  of  constructing  SNF  in  Figure  3. 

(c)  Solving  the  Group  Problem 

As  noted  before,  GMP  or  FGMP  can  be  solved  by  either  dynamic  programming 
or  a shortest  path  algorithm. 

(cl)  (c2)  DP  and  SOL 

The  subroutine  DP  solves  the  group  problem  using  a dynamic  programming 
algorithm,  whereas  subroutine  SOL  keeps  track  of  the  indices  of  the  solution  to 
the  group  problem.  The  main  feature  of  this  part  of  the  program  is  that  it  can 
list  as  many  alternative  optimum  as  computer  storage  allows.  It  is  desirable 
to  obtain  all  optimal  solutions  to  each  group  problem,  because  only  some  of  them 
may  yield  nonnegative  values  for  the  basic  variables.  This  is  equivalent  to 
recording  more  than  one  index,  say  j(k,g,2.),  2.-1,  . ..,  2.  when  ties  occur  in 

TT13X 

computing  the  minimum  in  the  recursive  relationship  (2) . The  current  program 

is  capable  of  storing  up  to  five  indices,  i.e.,  I =5,  for  each  element  of  the 

max 

group.  It  can  be  expanded  if  computer  storage  allows.  If  there  is  more  than 

£ indices  due  to  ties,  a new  index  will  not  be  stored.  In  this  sense,  "all" 
max 

alternative  optimum  may  not  be  found.  A flow  chart  representing  a general  out- 
line of  the  DP  algorithm  is  in  Figure  4. 

(c3)  SPA 

This  subroutine  obtains  the  network  representation  of  the  group  problem, 
and  then  uses  a,  shortest  path  algorithm.  Retrieving  the  values  of  the  solution 
is  the  same  as  (c2).  There  are  several  alternatives  for  this  algorithm.  Conven- 
tional algorithms  are  given  by  Dijkstra  [D2],  Dantzig  [D3] , Floyd  [FI],  Farbey 
et.al.[F2],  and  Yen  [Yl] . Moreover,  the  resulting  network  is  highly  structured. 


f 


Results  from  LP 


LP  optimal  basis  ’ 

D = I basis  determinant 
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S'  Go  to  (C) (See  Fig.l) 


Solution  algorithm  for 
the  group  problem 
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FIGURE  2: 


GENERAL  FLOW  DIAGRAM  OF  THE  CONSTRUCTION  OF  A GROUP  PROBLEM 
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quare  matrix,  B«(b  ijM 


i,j-l,...,M;  m-M 


Interchange  rows  and  columns  such  that  bU  is  the  element  of 
smallest  absolute  value  among  all  nonzero  elements  in  the  matrix 


5j^  divides  the  remaining  ^ 
fow  1 elements  b^,  (j»2 , . 


2 If  b^  dees  not  divide  b^for  some  j • k, 

— } blk  " nkbll  + q»  and  subtract  n^  times 

column  1 from  column  k so  that  b ^becomes  q. 


TT^ divides  the  remaining- 
column  1 elements  b^^(i=2, 


There  is  a row  k for  which  b,  , »n,  , , + q 

kl  k 11  ^ 

and  subtract  n^  times  row  1 from  row  k so 
that  hkl  becomes  q. 


Jb-j^  divides  row  one  and  column  one. 


bj^*=n^bj^  and 


’b,  ,«,m,b,  , . From  each  col  .mu  j ( j >2)  subtract  n. 

| il  i 11  — j 

times  column  1 and  from  each  row  i(l>2)  subtract 


times  row  1 


divides  eveiv  element 


in  the  subnatrix  (b^),  1* 

m ? ^ 


iThoro  is  an  1 n)  Add  n 


entry  b^ 
(2<i,j<m) 
for  which 

!Vn  hU+*‘ 

Bring,  q into 
the  (1,1)  (JO- 


times  row 


b)  Subtract 
column  1 


column  j 


c)  Inter- 
change 
column  j 
with 
column  1 


■*11  ' ° 


Multiply  row  1 by  -1 


|6 (halt  row  1 and  column  1 of  this  matrix  (b^  is  one 

of  the  diagonal  elements)  and  consider  the  (m-1)  x (m-1) 
submatrix. 


smith  tlormal  Karm'N, 
lHagona  1 i ::n!  Kan  Is) 


FIGURE  3:  F1.0W  MAGRAM  OF  ”•1!!'.  SMF  CO'il’l'TATIO'! 
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e.g.,  there  are  as  many  arcs  into  a node  as  there  are  out  of  it,  and  the  costs 
are  also  symmetric.  This  suggests  a special  purpose  procedure  should  be  used 
(see  also  Chen  and  Zionts  [Cl]).  Our  SPA  program  is  based  on  Yen’s  algorithm 
[Yl]  as  it  appears  to  require  the  fewest  number  of  computations. 

To  examine  the  structure  of  the  network,  consider  the  example  below. 


Minimize 


3 + 4 Xj  + 5 


subject  to  /4\  /(A  /(A  / 8\ 

feh  +i!p  +(°p 1 io) <mod  i2> 

and  x^,  x^,  X3  ^ 0,  integer. 

The  associated  D (distance)  matrix  for  this  problem  appears  in  Figure  6.  Note 
that  the  order  of  oi^  (denoted  N0(1))  * 3,  NO(2)  ■ N0(3)  ■ 2,  and  G(cij)  f G(a) 

= 12  for  all  j.  Then  the  distance  matrix  of  the  network  appears  as  in  Figure  5. 

Once  the  distance  matrix  is  constructed,  the  shortest  path  algorithm  is 
used.  The  steps  in  Yen’s  shortest  path  algorithm  is  described  here.  We  use 
the  following  notation: 

(I),  1*0,  ...,D-1;  the  nodes  of  the  network  (Dnodas)  where  (0)  is  the 

ii 

origin. 

II(I)  , I = 0,  1,  ...,D-1;  the  node  number  stored  in  the  Ith  cell  of  II. 

(1,J),  I + J;  the  directed  arcs  from  (I)  to  (J) . 

d = [d(I, J) ] ; the  distance  matrix  where  d(I,d)  is  the  distance  of  arc  (I,J) . 

F(I),  I = 0,  1,  . the  tentative  or  permanent  shortest  distance  from 

(0)  to  (I). 

Then  F(J*)’s,  the  lengths  of  shortest  paths  from  (0)  to  each  (J) , can  be  obtained 
as  follows: 


I.  Let  L - 0,  K - D-l,  F(0)  - 0,  H(I)  - I,  and  F(I>  - • for  I - 1,  2 D-l. 


II.  For  I - 1,  2,  . . . ,D— 1,  do  steps  A,  B,  C as  follows: 


? 
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A.  Let  J - H(I) . 

B.  Compute  F(J)  = rain  [F(J)  + d(L,  J)  ] . 

C.  If  the  value  of  F(J),  say  F(J*) , is  less  than  the  current  minimum  during 
this  execution  of  step  II s replace  J*  by  J and  note  the  corresponding 
value  of  I by  setting  I*  ■ I . 

III.  Label  L ~ J*  arid  d(l*)  = H (K) . 

IV.  Let  K *•  K-l.  If  K > 0 go  to  II;  otherwise,  if  K **  0,  stop. 


(d)  The  Case  When  x^  £ 0 

A subroutine  CONVER  finds  the  solution  to  the  integer  program  from  the 
optimal  solution  to  the  group  problem.  If  the  optimal  solution,  x.^,  for  the 
relaxed  group  minimization  problem  yields  nonnegative  basic  solution,  Xg,  then 
(Xg,  x^)  is  a solution  to  the  original  IP  problem.  If,  on  the  other  hand,  one 
or  more  of  the  basic  variables  turn  out  to  be  negative,  we  have  to  seek  the 
smallest  value  of  cx^  for  which  xB  >_  0 and  x^  satisfies  the  constraints  of  the 
group  problem.  At  least  three  alternatives  exist  here;  namely 

(dl)  A branch  and  bound  enumeration 
til 

(d2)  A k shortest  path  algorithm 

(d3)  A modified  dynamic  programming  algorithm. 

The  current  program  includes  (dl) . (d2)  is  now  being  incorporated. 

(dl)  BANDB 


A modified  dynamic  programming  algorithm  was  developed  by  White  [Wl] 
which  seeks  the  smallest  shortest  route  for  which  x_  > 0.  However,  this  involves 

O — 

considerable  computations.  Instead  of  using  this  recursive  relationship,  we 
will  introduce  a branch  and  bound  enumeration  which  is  similar  to  the  Dakin  [Dl] 
variation.  A flow  chart  of  this  subroutine  is  in  Figure  6.  Our  branching 
strategy  is  to  check  all  branches  emanating  from  a chosen  node.  For  example, 
in  Figure  7 with  3 nonbasic  variables,  there  exist;  three  possible  branches 
leading  to  £,  £+1 , £+2  nodes  emanating  from  node  k.  All  of  them  are  examined. 
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^NAL,  NBE; 


DP  table  NF(K),  JJ(K 


^L)) 


LZBAR  ■ 999999  (initialization) 


NX(1)  >_  1,  NX(J)  >_ 

0 (J-2,  NG) 

' 

! 4 

Change  right  hand  side  according] 
to  the  imposed  constraints 
NBE  (I)  —*■  NBEC(I) 


..  . > 

f 

NG 

LB  « NF(NT)  + I 

NCB(J)  * NX( J) 

S 

t 

OL 

Retrieval  of  the 
JdP  solution 

i 

> 

CONVER 

Using  the 
variables 
variables 

nonbasic. 
find  the 

Renew  the  dangling  node 
(This  is  necessary  only  when 
we  find  an  improved  solution 
from  the  last  node.) 


.Basic  solution  > 0 


no 


Improved  solution  found, | 
tore  this  solution. 
ILZBAR  = LB 


Find  the  dangling 
node  with  minimum 
LB  value 


FIGURE  6:  A GENERAL  OUTLINE  OF  THE  BRANCH  AND  BOUND  ENUMERATION 
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FIGURE  7:  BRANCHING 

As  we  Impose  more  strict  conditions,  the  feasible  region  is  more  restricted 
thus  increasing  the  optimal  value  of  the  objective  function.  The  node  selection 
rule  is:  find  the  node  with  the  minimum  of  the  optimal  linear  programming 
objective  values  of  all  dangling  nodes.  Thi*  node  is  selected  as  the  one  from 
which  we  branch  on.  Hopefully,  it  will  produce  an  optimal  solution  to  the  group 
problem  quickly.  In  the  current  version  of  the  program  as  many  as  300  dangling 
nodes  can  be  stored, 

3.  COMPUTATIONAL  EXPERIENCE 

The  algorithm  has  been  coded  in  FORTRAN  IV  and  tested  on  a UNIVAC  1108 
computer  at  Chi  Corporation,  Cleveland,  Ohio.  At  this  time  only  rather  modest 
sized  IBM  test  problems  appearing  in  Haldi  [H2]  have  been  solved.  Table  3 
gives  a detailed  summary  of  running  times  in  seconds  for  each  phase  of  the 
system.  Unfortunately,  some  I/O  time  is  included. 

Table  3 also  includes  the  results  of  other  computational  studies,  i.e.. 
White  [Wl]  and  Shapiro  {S3].  White  (1966)  used  an  IBM  7094,  which  is  substan- 
tially slower  than  the  results  using  machines  such  as  a UNIVAC  1108  or  IBM  360. 
Still,  it  i3  observed,  in  general,  that  the  shortest  path  algorithm  works 
better  than  the  DP  algorithm.  There  is  not  much  difference  between  Shapiro's 


results  and  our  results.  Exceptions  are  those  requiring  branch  and  bound  enu- 
meration, for  which  Shapiro's  algorithm  works  better.  Also  note  that  for  IBM 
test  problems  no.  1 and  no.  2 with  D ■ 32,  our  DP  technique  works  faster  than 
Shapiro's  algorithm. 

A,  SUGGESTED  STRATEGIES 

Table  A summarizes  some  general  results  and  Inferences  suggested  by  the 
computational  results.  From  these,  we  can  draw  at  least  preliminary  conclusions 
as  to  which  form  of  the  group  problem  should  be  used,  GMP  or  FGMP,  and  which 
algorithm  should  be  adopted,  DP  or  Network.  Generally  speaking,  for  small 
problems  (i.e.,  ones  with  a small  number  of  rows  and  a small  basis  determinant 
in  absolute  value),  GMP  works  satisfactorily,  but  for  large  problems  FGMP  is 
definitely  preferred.  We  elaborate  upon  this  and  list  our  suggested  algorithm 
strategies  in  Table  5.  The  reader  should  realize,  however,  that  these  conclu- 
sion." are  drawn  upon  very  preliminary  computations. 

Table  5 indicates  that: 


1)  when  both  m and  D are  small,  any  approach  should  work. 

2)  when  the  group  is  cyclic,  the  network  approach  without  the  SNF  (i.e. , use 


GMP)  is  best,  since  we  only  have  to  find  n^  such  that  g^  « n^  g^,  where 
generates  the  group.  The  SNF  is  worse  when  the  nunber  of  nonbasic  variables 


that  is,  the  number  of  indices  k,  is  small.  Thus,  we  feel  GMP /NETWORK  is 
better  than  FGMP /NETWORK,  when  the  group  is  cyclic. 

3)  when  the  group  is  not  cyclic,  the  network  approach  with  SNF  is  usually  best, 
since  the  SNF  can  be  used  to  find  tne  number  of  cyclic  subgroups  which 
generates  the  group.  Elements  whifch  generate  the  group  can  be  used  to  find 
the  entire  network. 


DP  Algorithm  and  the  SPA  Algorithm 


It  will  be  clear  from  Table  3 that,  generally  speaking,  SPA  works  from 


5 to  10  times  faster  than  DP.  This  trend  is  much  clearer  as  D increases.  For 


TABLE  3(b):  RESULTS  II 


TABLE  3(c):  RESULTS  III 
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Dynamic 

program- 

ming 


Network 


No  SNF  conversion  time  is  required. 
This  will  probably  be  inefficient 
especially  with  D large,  because 
of  the  number  of  states  (i.e. , D) . 
This  will  require  more  memory. 


. This  should  work  well  for  small 
(in  number  of  rows  and/or  the  size 
D)  problems  at  the  cost  of  more 
memory  requirements  for  the  dis- 
tance matrix. 

. After  converted  into  a network,  the 
group  of  elements  are  not  carried 
over  to  the  network  optimization. 

. No  SNF  time  is  required. 


Since  the  number  of  rows  in  FGMP, 
m_,  is  usually  of  the  order  of  1 
to  5 regardless  of  the  value  of  m 
this  will  be  more  efficient  than 
the  GMP/DP  strategy,  especially  in 
large  (many  row  problems. 

Generally  the  network  algorithm  will 
work  better. 

This  is  the  most  popular,  and  prob- 
ably most  efficient  strategy. 

This  should  work  well  for  larger 
problems. 

Both  SNF  conversion  time  and  network 
representation  time  are  required. 


TABLE  4:  SOME  GENERAL  INFERENCES 

example,  see  the  computations  with  the  Hold!  No.  2 problem  (D=258) . The  differ- 
ence in  time  is  directly  attributed  to  the  difference  of  DP  and  SPA  time.  Even 
though  the  values  for  D are  rather  small  in  the  problems  treated  here,  SPA  seems 
to  be  more  advantageous.  Moreover,  SPA  requires  substantially  less  computer 
memory  requirements.  This  is  because  SPA  does  not  carry  the  or  X^  columns 
during  the  network  optimizations,  since  these  coefficient  columns  correspond  to 
group  elements  and,  hence,  nodes  (see  Salkin  [SI]). 

GMP  and  FGMP 

For  the  rather  small  problems  solved,  the  results  indicate  that  dlagon- 
alization  of  the  (LP  optimal)  basis  via  Smith’s  Normal  Form  is  not  preferable. 
This  may  be  partially  because  our  computer  subroutine  representing  the  SNF 
conversion  is  not  written  well.  But,  on  the  other  hand,  it  is  intuitively 
clear  that  for  small  (especially  in  the  number  of  row)  problems,  diagonalization 


does  not  speed  up  computation  time.  This  will  not  be  the  case  for  larger  (in 


1 


Small 


Large 


1.  GMP /NETWORK** 

2.  GMP/DP 

Group  cyclic  or 
not  cyclic 

1.  GMP /NETWORK 
Group  cyclic 

1.  FGMP /NETWORK 
Group  not  cyclic 

2.  GMP/DP 
Group  cyclic 


1.  FGMP /NETWORK 
Group  cyclic  or 
not  cyclic 


1.  GMP /NETWORK 
Group  cyclic 

2.  FGMP /NETWORK 
Group  not  cyclic 


*1.  first  choice,  2.  second  choice 
**GMP/NETWORK  stands  for  solving  GMP  by  the  network  approach. 

Others  should  be  interpreted  similarly. 

TABLE  5:  SUGGESTED  STRATEGIES* 

terms  of  rows  and  the  value  of  D)  problems.  Further  investigation  will  be 
needed  to  conclude  under  what  conditions  which  is  better. 

5.  FUTURE  WORK 


Detailed  comparisons  of  our  computational  results  with  others  indicates 
that  further  improvement  of  the  program  will  be  possible  in  the  following 
subroutines.  These  minor  changes  should  make  the  system  more  efficient. 

1)  Smith  Normal  Form 

The  current  subroutine  used  to  obtain  the  Smith  Normal  Form  is  based  on  the 
work  in  Hu  [HI].  This  subroutine  is  in  a preliminary  form  and  should  be 
refined.  Another  approach,  given  by  D.A.  Smith  [S6]  , is  being  examined. 

2)  Branch  and  Bound  Enumeration 


Our  current  subroutine  containing  the  branch  and  bound  enumeration  is 
rather  primitive.  This  is  especially  true  for  both  node  and  branch  selec- 
tion rules.  This  subroutine  will  become  very  inefficient  as  D increases. 
Modifications  are  being  incorporated  in  both  node  and  branch  selection. 


I 


i 

; i . 


] 
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Finally,  major  points  to  be  studied  further  are: 

(1)  a further  investigation  of  the  degree  of  relaxation  used  to  define  the  GMP. 

(2)  inclusion  of  the  use  of  Lagrangian  multipliers  (as  suggested  by  A.  Geoffrion 
[G8] , et  al.)  and  Gomory  all  integer  cuts  (as  suggested  by  G.A.  Gorry  [G5], 
et  al.)  in  the  relaxation  strategies, 

(3)  inclusion  of  the  cuts  derived  from  functions  related  to  corner  poiyhedra 
(as  suggested  by  R.  Gomory  and  E.  Johnson  [G6,  G7])  in  the  implicit  enumer- 
ation tests, 

(4)  inclusion  of  the  k1^  shortest  path  algorithm  (as  suggested  by  B.  Fox  [F3]) 
if  a group  problem  does  not  solve  the  integer  program. 

(5)  the  use  of  non-optimal  dual  LP  solutions  to  produce  a group  problem. 

Points  (1),  (2),  and  (3)  are  mentioned  by  Salkin  [SI],  To  explain  (4) 
and  (5)  in  more  detail:  The  k*"*1  shortest  path  algorithm  is  being  incorporated 
into  the  program.  White  [Wl]  shows  that  the  integer  program  can  be  solved  by 
finding  the  kth  shortest  path,  possibly  containing  loops,  so  that  a non-negative 
solution  to  the  integer  program  is  produced.  Fox  [F3],  however,  points  out  that 
White's  approach  does  not  perturb  the  arc  lengths,  leaving  open  the  possibility 
of  cycling.  Another  problem  is  zero  and  duplicate  columns,  resulting  from 
reducing  each  updated  coefficient  column  to  its  fractional  part.  As  described 
elsewhere  [S5],  the  k*"*1  shortest  path  of  a network  associated  with  a group  prob- 
lem generally  does  not  solve  the  original  integer  program  when  duplicate  and/cr 
zero  columns  are  dropped  when  constructing  the  group  problem.  Therefore,  a 
more  complicated  procedure  is  required.  Our  procedure  repeatedly  uses  the 
shortest  path  as  in  [S5] . Com;utational  studies  are  being  made  to  test  this 
procedure. 

Another  interesting  thought  is  the  use  of  non-optimal  dual  LP  solutions 
to  produce  a group  problem.  In  order  to  generate  a group  problem,  the  cost  row 


ft 
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c ■ CgB  '*'N  - cN  must  be  ncnnegative.  If  we  use  the  dual  simplex  method,  this 
condition  is  always  satisfied.  Thus,  we  can  use  any  of  the  dual  feasible  solu- 
tions. It  seems  natural  that  a dual  feasible  solution  which  is  close  to  a dual 
optimal  (hence,  primal  optimal)  solution  is  preferred.  This  suggests  using  a 
dual  feasible,  not  necessarily  optimal,  solution  to  construct  a group  problem 
so  that  the  dual  feasible  solution 

(i)  corresponds  to  a basis  whose  determinant  is  small 

(ii)  yields  a cyclic  group. 

Criterion  (i)  will  make  the  group  problem  small,  and  (ii)  will  allow  a simpler 
application  of  the  DP  or  SPA  algorithm.  Both  points  allow  for  a faster  solution 
of  the  GMP.  Computational  studies  are  in  progress  to  test  this  strategy.  A 
later  memorandum  will  report  on  these  efforts. 
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APPENDIX  It  NOTATIONS 


1)  Constants 

Program  variable  name 

M 

N 

MM 

NG 

ND 

NDD  (=NO(J)) 


Usual  Notations 


det  B 


Number  of  rows  \ 

.T  , , . > of  the  original  problem 

Number  of  columns  / 

Number  of  rows  ( _ , 

Number  of  columns  ) o£  the  *rou>>  >>rol>lM' 
Absolute  value  of  the  determinant  of  basis  B. 
The  ordej^of  the  cyclic  subgroup  generated 
by  the  j column  of  the  group  problem. 


2)  Arrays 


NA( J , I) 

NB(I) 

NC(J) 

NAB(J.l) 

NB1(J,I) 

NXB(J) 


Coefficient  matrix 
Right  hand  side 
Costs 


of  the  original  problem 


Basis  of  LP  optimal  solution. 

Basis  inverse  (fractions  are  cleared  by 
multiplying  by  ND  * | det  B | ) . 

Indices  of  basic  variables 


NAL(J.I) 

NBE(I) 

NCB(J) 

NO(J)  (=NDD) 

MB(I) 

NXSOL 

NF(K,NT) 

JJ(K,NT,L) 

3)  Working  Indices 


B1  ' a0i 


f(k,g) 
j (kjgj*') 


Coefficient  matrix 
Right  hand  side 
Costs 


of  the  group  problem 


The  order  of  the  cyclic  subgroup  generated 

by  the  j column  of  the  group  problem, 
generated  by  the  SNF. 

Solution  for  the  group  problem. 

DP  table”\ ..  oN 
DP  tabluf(Kl'2) 


NT  = 1,  ND  (or  NDD) 
K or  NGG  or  J 
I 


For  group  elements. 

For  columns  of  the  group  problem. 

For  rows  of  the  group  or  original  problem. 
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APPENDIX  II  i SOME  COMMENTS  ON  THE  kth  SHORTEST  PATH  ALGORITHM 

As  mentioned  earlier,  an  alternate  to  the  enumeration  is  an  algorithm 

which  seeks  the  smallest  shortest  route  for  which  Xg  0.  A kt^1  shortest  path 

til 

algorithm  may  bo  used.  There  are  two  types  of  k shortest  paths  problems. 

th 

The  first  is  to  find  the  k shortest  paths  from  the  origin  to  the  sink  in  which 

loops  are  allowed,  the  second,  in  which  loops  are  not  allowed.  We  must  use  the 

first  type,  since  the  smallest  shortest  route  for  which  Xg  >_  0 may  contain 

loops  [SI].  Fox  [F3]  developed  a kth  shortest  path  algorithm  which  can  be  applied 

to  the  group  problem,  but  no  computational  comparison  among  alternative  strategies 

til 

is  available.  Other  kL  shortest  path  algorithms  with  loops  are  in  Hoffman  and 
Parley  [H3]  (1959),  Bellman  and  Kalaba  [Bl]  (1960),  and  Sakarovitch  [S4]  (1966). 


